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Abstract. In this paper we develop a rigorous foundation for the study of integration and measures 
on the space ’Siy') of all graphs defined on a countable labelled vertex set V. We first study several 
interrelated n-algebras and a large family of probability measures on graph space. We then focus on 
a “dyadic” Hamming distance function IHI^ 21 which was very useful in the study of differentiation 
on ^(V). The function H-H^ ^ is shown to be a Haar measure-preserving bijection from the subset 
of infinite graphs to the circle (with the Haar/Lebesgue measure), thereby naturally identifying the 
two spaces. As a consequence, we establish a “change of variables” formula that enables the transfer 
of the Riemann-Lebesgue theory on R to graph space f^(U). This also complements previous work 
in which a theory of Newton-Leibnitz differentiation was transferred from the real line to W{V) 
for countable V. Finally, we identify the Pontryagin dual of ^{V), and characterize the positive 
definite functions on ^{V). 


1. Introduction and main results 

The study of very large graphs and their limits has recently been the focus of tremendous 
interest, given its importance in a variety of scientific disciplines including probability and statistics, 
combinatorics, computer science, machine learning, and network analysis in various applied fields. 
In this regard several limiting theories have been developed in the literature. Prominent among 
these is the comprehensive theory of graphons, which are limits of (dense) unlabelled graphs (see 
|Loj and the references therein). 

In the present paper, we work in the parallel setting of labelled graphs and their limits. Our 
motivation comes from the fact that often graphs in real-world situations and observed network 
data are labelled, and each vertex has a specific meaning. Similarly in theoretical probability such 
as Markov random fields and their applications, nodes in graphs represent variables that are not 
exchangeable owing to the dependencies in the underlying model. This provides motivation to 
study the space of labelled graphs and their limits. 

In |KR1| a framework was introduced in which to study all finite labelled graphs at once; namely, 
the space f^(U) of graphs with a fixed countable, labelled vertex set V. The algebraic and topolog¬ 
ical properties of ^(V), as well as continuous functions on ^(V), were studied in [KR,1| . Moreover, 
a theory of differentiation on graph space was developed in |KR1] : see also |DGKRj for differenti¬ 
ation in the unlabelled setting in graphon space. Note also that the space of graphons is naturally 
equipped with a large family of measures that arise from sampling. We now explore the parallel 
setting of labelled graph space, with the aim of studying measures on ^(V) and developing a theory 
of integration. This is the goal of the present paper. 

The space ^(V) is a compact abelian group; hence the associated Haar measure naturally gives 
rise to a theory of integration. Our first objective is to identify and study the Haar measure. The 
next goal of this work is to explore the connections between Haar integration on graph space and 
the Riemann-Lebesgue theory on R. As a consequence of our investigations, we show below that 
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integration on ^(V) can be reduced to that on the unit interval. This is akin to |KR1] . in which 
differentiation on ’^(V) was shown to be closely related to the one-variable Newton-Leibnitz theory 
on M. 


In this section we will state the main results of the paper. We begin by setting some notation. 

Definition 1.1. Given a fixed labelled set V, define the corresponding (labelled) graph space ^f(V) 
to be the set of all graphs with vertex set V. In other words, {f(V) = {0,where 
Kv is the complete graph on V. Also define %(G) to be the set of all graphs with finitely many 
edges, and ^i{V) to be the set of all co-finite graphs - i.e., the complements in Ky of finite graphs. 

Henceforth every labelled graph with vertex set V will be identified with its edge set, which is a 
subset of Ky- Note that '^{V) is the set of all functions / : Ky —)• Z/2Z, the discrete field with two 
elements. This makes ^f(V) a commutative topological Z/2Z-algebra under pointwise addition and 
multiplication. In particular, the binary operation G + G' := GAG' makes ^{V) into an abelian 
topological group, where A denotes the symmetric difference and the zero element 0 G if(V) is 
given by the empty graph on V. Note also that {f(V) is 2-torsion, i.e., G-l-G = 0 for all G G ^(V). 

We next discuss the topological structure of labelled graph space {f(V') for a countable vertex 
set V, as studied in |KR1| . The following family of metrics on ^(V) was crucially used in [KRl] 
in developing differential calculus in ^f(V}, and is also important for the purposes of the present 
paper. 


Definition 1.2. Suppose V is countable and ijj : Ky — ^ N is a fixed bijection. Given a > 1, define 
d<fia ■ '^(y) X ^(R) [0,oo) and : ^{V) -)■ [0,oo) via: 

d^AG,G'):= l|G||^,„:=d^„(0,G). (1.3) 

eeGAG' 

Next, a sequence {Gn : n G N} in '^{V) is said to converge (to G & ^f(V)) if the indicator sequences 
{legGn : R- S N} each converge (to Ibgg) for each edge e G Ky. 

The following theorem collects together some of the topological results in [KR1| on labelled graph 
space which are needed for the purposes of this paper. 


Theorem 1.4 f |KRl| l. For a fixed labelled set V, the set1^{V) of graphs is a commutative, totally 
disconnected, compact Hausdorff topological 'Z/27j-algebra. 

Now suppose that V is countable and : Ky N is a fixed bijection. 

(1) The maps {d,^^ : a > 1} are translation-invariant metrics on '^{V), which are all topologi¬ 
cally equivalent and metrize the above notion of graph convergence (i.e., they generate the 
product topology on ^{V) = {0, 1}^''). 

(2) The sets %(R),1#l(R) are dense in ^(V). 

(3) The map 2d^pfiQ,—) = 2||-||^3 : ^(V) —)• [0,1] is a homeomorphism onto the Cantor set. 

Thus is a compact metric space. 

(4) The map = ||•||^2 ■ ^(R) [0)1] ® surjection, which is a bijection outside 

%(R). For every finite nonempty graph G, there exists a unique co-finite graph G' such 
that 11 gii ^_2 = IIG'II^, 2 - 


We now present the main results in this paper. Since 1^(R) is a compact abelian group, it is 
natural to seek out its associated Haar measure. We identify this measure in our first main result. 
We also show that the Haar measure is intimately connected to the distinguished metric 11-11^2 
(for any ip) that was used in |KI11| to develop a differential calculus on 1^(R). More precisely, the 
following holds. 
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Theorem A. Fix a countably infinite set V. The Haar measure /iHaar on '^[V) is the unique 
probability measure fii /2 induced from the Bernoulli{^)-measure on each factor {0,1} of ^{V). 
Now given any bijection : Ky —)• N, the Haar measure of any open or closed H-H^ 2 -ball (in (1 /)) 
of radius e G [0,1] is e. 

Note here that the Borel cr-algebra ^<s{y) of ^f(V}, as well as the Haar measure ^ 1 / 2 , do not 
depend on the choice of labelling : Ky —)■ N. 

It is natural to ask if the measure space {f(V) with its Borel cr-algebra, can be modelled by a 
more familiar probability space. (This is akin to Theorem 11.41 which provided familiar topological 
models for graph space.) Note moreover that the last assertion in Theorem has an obvious 
analogue for the usual Lebesgue measure, which is in fact the Haar measure on the real line. It 
is now natural to ask if the two Haar measures are related. The following result answers both of 
these questions, and shows how to transfer integration from ^(V) to M. 

Theorem B. Fix a bijection if : Ky —)• N. 

(1) The map ||•||^ 2 • ^(1^) [0,1] ~ or to the circle = M/Z - is a measurable, Haar measure¬ 

preserving map that is a bijection outside the countable (measure zero) sets '^o{V),Wi{V). 

(2) Suppose f : [0,1] — )• [—00,00] is Lebesgue integrable. Then, 

= [ /(®) dx. 

Jo 

Conversely, for all integrable g : ^{V) —>• [—00,00], we have 

l^MHaarb] = [ 5 ( ( II ' II ^.,2 ) “ ) dx. 

Jo 

Thus, Haar integration can be carried out on labelled graph space by transferring the classical 
Lebesgue theory from the unit interval (or the circle) to ^(V). 

The remaining sections are devoted to proving the above results. We add moreover that addi¬ 
tional results concerning Fourier analysis, the Pontryagin dual, and positive dehnite functions for 
if(V) are shown in Section [3.21 below. 

2. Measures on graph space 

In this section we develop the necessary tools required to show TheoremEJ We begin by studying 
several u-algebras on graph space and showing how they are related. We then study probability 
measures on ^(V) and prove Theorem lAl 

2.1. (T-algebras on graph space. We begin with an arbitrary (fixed) labelled index set V of 
vertices. Let V(e) denote the vertices attached to an edge e G Ky; then f^(l/) = Xegic^'P(Ay(g)) 
is the Cartesian product of power sets, and each set is a fj-algebra of size 2. Define the product 
(7-algebra Smeas on ^(V) to be the (7-algebra generated by the cylinder sets 

'S'eo := Xe7^eo{0){e}} X (eo), eo G Ky. (2.1) 

We now dehne several other (7-algebras on ^(V), as well as a closely related family of sets. 
Definition 2.2. Given disjoint subsets F Ky, dehne 

^(lo, h) := {G G ^( V ) :hcG,IoCKy\ G}. (2.3) 

Now dehne the following (7-algebras on 5^(H): 

• J^<g[y) is the Borel a-algebra, generated by all open sets. 

• So is the (7-algebra generated by all compact sets. 

• Tig is the (7-algebra generated by all sets for disjoint Io,Ii C Ky. 
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• 0 is the (7-algebra generated by all h) for finite (or countable) disjoint Io,Ii C Ky- 

Consider the case when V, and hence Ky, is countable. In this case, as shown in |KR1] . the 
product topology on the compact space can be metrized; this yields another candidate a- 

algebra, as described presently. The main result of this subsection relates all of the above (j-algebras. 

Theorem 2.4. Suppose V is countable, and d is a metric on {f(V) that metrizes the product 
topology. Define Tid^baii to he the a-algebra generated by the open (or closed) d-balls in^iV). Then, 

Smeas = ^£,0 = = T,d^ball = ^^{V) = ^0- 

In order to prove Theorem 12.41 some preliminary results are needed. The first result collects 
some basic facts about the sets 

Lemma 2.5. Suppose V is arbitrary and Iq, Jq, Ji C Ky are all disjoint. 

(1) Then one has: 

(f(IoU Jo,/iU Ji) = (f(/o,Jo)n(f(/i,Ji). (2.6) 

In particular, is inclusion-reversing in each argument. 

(2) Given S C ^(C) 9 G, define S + G := {G'+ G : G' € S}. Then, 

(f(/o,/i) =(f(/oU/i,0) + /i, (2.7) 

where for every I C Ky, is an ideal of (the 'I,/2Z-algebra) ^(V). 

(3) Given any G &^{V), 

h) + G = S ((/o \ G) ]J(/i n G), {h \ G) ]J(/o n G)) . (2.8) 

(4) Given disjoint sets Io,Ii C Ky, the set is closed in Ky. It is open if and only if 

loUh is finite. 

Proof. All but the last part are easy to prove using the definitions. For the last part, note that for 
finite disjoint /o,7i C Ky, S'{Io,Ii) is closed as well as open in ^{V). Hence S'{Iq,Ii) C f#(I4) is 
closed for all disjoint Io,Ii C Ky, by using Equation (|2.6j) . Finally, suppose that /qU/i is infinite; 
the goal is now to prove that its complement in (Z/2Z)^'^ is not closed in the product topology. 
To do so, it suffices to produce a sequence Gn ^ S{Iq,Ii), that converges to a graph Gq G S{Io,Ii). 
Thus, fix a countable subset {in : n G N} C IqU/i, and define Gn '.= /iA{z„}, Gq := Ii G S{Io,Ii). 
It is easy to check that Gn —>• Go in f^(E), and that this sequence satisfies the desired properties. □ 

In order to state and prove the next result, the following notation is required. 

Definition 2.9. Suppose V is countable. Fix a bijection : Ky —)• N and define F'„(V’) := {e S 
Ky : 'fi{e) < n}. Given a > l,e > 0, and G G ^{V), define B{G,e, 11-11.0^) to be the open ball in 
i'^{V),d^^) with center G and radius e, and B{G,e, 11-11^2) closure in fi0{y),d^pfi). 

The last preliminary result shows that the sets S‘{Iq, fi) lie in the Borel (T-algebra for finite Io,Ii. 

Proposition 2.10. Suppose V is countable. Fix a bijection : Ky —)> N, and given disjoint subsets 
Io,h C N, define S{h,h) := S{fi-\h),fi-\h)). 

(1) ifhW Ii = {1, ... ,n} for some n, then 

cF{Io,h) = B{fi-Hh),2-^,\\-\\^^,)l[{Ky\fi-\lo)} 

= B{fi-\h), 2-\ |H|^_ 2 ) U B{Ky \ fi-\lo), 2-", 11-11^^2) 
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(2) For all finite disjoint is a finite union of open balls, as well as closed balls. 

Alternatively, it can be partitioned into finitely many open balls and a finite set. 

Proof. 

(1) For the first equality, it is clear that the left-hand side is contained in the right. To show 

the reverse inclusion, if G is in the right-hand side, then GAip~^{Ii) cannot intersect Enifi) 
(which was defined in Definition 12. 9 j) . so it must be disjoint from and must contain 

The second equality is now easy to show, and one inclusion in the third equality 
as well. For the converse, if G G (Iq, /i), then either -|- 1) G G - whence G is in the 

second closed ball - otherwise G is in the first closed ball. 

(2) Suppose max(/o ]J/i) = n, and {1,... ,n} \ (Jq U fi) = {mi < ■ ■ ■ < mi}. Then: 

U Jo,/i U {mi,..., m/} \ Jo). 

The result now follows from the previous part. 

□ 


Finally, we use the above results to prove the main result in this subsection. 

Proof of Theorem \2.4\ It is clear by Definition 11.21 that every G G ^(V) is the limit of a sequence 
Gn of finite graphs: set G„ := Gn En{fi). Now C '^d,baU'-, the reverse inclusion is obvious. 

Also note that the u-algebras generated by the open and closed J-balls are both equal. 

We now claim that some of the inclusion relations hold among the a-algebras defined above, for 
arbitrary vertex sets V. Namely, we claim for all sets V: 

Smeas = ^S‘,0 C C = Sq- (2-11) 

To show Equation (j2.1ip . note that since ^(V) is a compact Hausdorff topological space by 
Theorem [H hence K C '^{V) is compact if and only if ^{V) \ K \s open. This proves that 
= Sq. Also note that is generated by all sets where we may assume Io,Ii to 

be either finite or countable - that both of these choices yield equivalent cj-algebras follows from 
repeated applications of Equation (12.61) . Next, note that Si^ = (f(0,{io}) for all io G I. Hence if 
Jo,/i are finite disjoint subsets of Ky, then 

^{Io,h) = 

iG/o i£li 

This proves that Emeas = Next, that E^^q C E^ is obvious. Einally, E^ C by Lemma 

[231 since the sets Ji) are closed for disjoint Io,Ii C Ky. 

Given Equation (12.lip , it remains to prove that every open set U C ^(V) is in E^. Eirst, fix 
any G ^ U that is not cofinite, i.e., G ^ Wi{V). Since U is open, H(G, e, H-H^ 2 ) ^ ^ for some 
e > 0. Choose N > 0 such that 2~^ < e, and fix n > such that ^ G (since G ^ ^i(E)). 

Dehne the finite graph Go = En-iifi) n G G %(E). Then since n ^ V’(G') and G ^ ^i(V), hence 
||G - Go ||,^,2 < < 2-^ < e. Thus, 2-^ < 2-^-^ < e/ 2 . 

Now use the first part of Proposition 12.101 with Ji := {-(/(Go)} C (1,... , n — 1}. It follows that 
B{Go,2~^, 11-11.0 2 ) ^ Moreover, 2“"- < e/2, so 

G G H(Go,2-3 |H| 0 _ 2 ) C B{Go,e/2, \\-\\^^,) c H(G,e, |M| 0 ^ 2 ) ^ U- 

But now we are done: U is the union of the countable set U n ^i(V), and for each G GlJ\ ^i(V}, 
the open ball B(Go, 2 “"’, 11-110 2 ) above. Since each of these sets is in E^, and there are only 
countably many such sets (since they are in bijection with a subset of %(E) x N), hence is a 
countable union of elements of E^. Thus, Id G E^, whence i^^(y) C E^, as desired. □ 
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2.2. Haar measure. We now define and study a large family of measures //p on the space 
eventually focussing on the Haar measure and the proof of the first main result, Theorem [Al Given 
any labelled set V and any function P : Ky ^ [0,1], the map /zp^e assigning P{e) to {e} and 
1 — P{e) to 0 is a Bernoulli probability measure on the Bernoulli space Ky(^f,y Now recall the 
(7-algebra Smeas (|2.ip . and define the product measure /zp on finite intersections of these sets via: 
^^p{Sel n • • • n Se^) := nr=i ^i^i) distinct e* G Ky. One can ask if this information is sufficient 
to determine ^p on {^{V),T,raeas)- To answer this question, recall the following results. 

Proposition 2.12 ( |.TPt Theorem 6.1 and Corollary 6.1]). Suppose a a-algebra {Q,s/) is generated 
by a subset C G £/ that is closed under finite intersections. 

(1) Two probability measures on si are equal if and only if they agree on C. 

(2) Suppose C is an algebra, and /z' : C —>• [0,1] is a probability measure (satisfying countable 
additivity as well as that /z'(H) = Ij. Then p! extends uniquely to a measure on all of si. 

The proof uses the Monotone Class Theorem m Theorem 6.2]. In particular, the result affirma¬ 
tively answers the above question. Thus pp satisfies the following properties when V is countable: 

• pp IS determined uniquely by its restriction to finite intersections of the sets Se^ ■ In par¬ 
ticular, pp is a probability measure on and one writes: pp := neeR'v l^P,e- 

• For all disjoint the sets and all Borel sets are /zp-measurable. 

• In particular, every locally constant function on (H) \ C (where C is a countable set) is 
/zp-measurable for all P : Ky —>• [0,1]. 

Remark 2.13. A special case is the measure pp for p G [0,1], given by P{e) = p Ve. This is 
precisely the Erdos-Renyi model for ^(V). When V is countable, this construction generalizes 
the analysis in |Cam| . where ^f(V) is identified (via a bijection if : Ky —)• N) with 2^ = {0,1}^, 
the space of binary sequences, as well as with [0,1] via the binary expansion of any real number 
X G [0,1]. Note that this map is precisely the function 11-11^2- Cameron [Cam| also informally 
writes down a measure on ^(V) as being induced from countably many independent tosses of a 
fair coin; this is precisely the Erdos-Renyi measure /Zi /2 above. 

We now outline the contents in the remainder of the paper. The immediate task is to prove 
the first main result in the paper (Theorem Ej) using the above preliminary results. Following the 
proof, in Section [2.31 we compute expectations of several real-valued functions on graph space with 
respect to the Erdos-Renyi measures pp, as an illustration of how to work with these measures. 
Having computed the Haar-expectations of specific functions, we then prove the other main result. 
Theorem [B] (in the following section); this result deals with transporting the Haar-expectation of 
arbitrary functions between graph space and the real line. The paper concludes with a study of 
Fourier analysis on f^(R). 

Proof of Theorem HI We make the following claim: 

For any V (and up to scaling), when restricted to Smeas = Tig-y, the Haar measure necessarily 
equals pp with P{e) = 1/2 for all e G Ky. In other words, /ZHaar = hi /2 on Smeas- 

That /ZHaar exists and is the unique translation-invariant probability measure on ^{V) follows by 
a classical result of Weil Iw^ (also proved by Cartan), since f#(H) is a compact topological group. 
Now suppose I C Ky is finite. Then for all partitions I = /o]/[/i, one computes using Equation 
(EH): 

hnaa . r {<^{ h , h )) = hnaar {<^{ Io , h ) + h ) = /^Haar(<« (-1, 0)) , 
by translation-invariance. Now since ^(V) = \ Ifi), hence 

loci 

/XHaar(^(/o,/l)) = 2-1^' = /Zi/2((f (/q, ))• 


(2.14) 
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Note that the sets generate Hence //Haar = ^ 1/2 on by Proposition 12.121 since 

the collection of sets (for finite disjoint C Ky) is closed under finite intersections by 

Equation (12.61) . 

We now prove the main theorem using the claim. Note that computing /rnaar on Smeas uniquely 
determines the Haar measure when V is countable, since when V is countable (by 

Theorem 12.41) . Thus ^Haar = Mi/ 2 - 

Next, we assert that the Haar measure of a ||•||^ 2 ■ball of radius e £ [0,1] is e. The assertion 
is clear for e = 0 (i.e. for the empty set) and e = 1 (which yields the entire space ^(V) except 
one point), since points must have Haar measure zero or else /UHaar(5^(H)) = 00 . Now assume 
e £ (0,1) and G = 0 (by the translation-invariance of 111 / 2 )- It is enough to prove the assertion 
for e of the form 2“”^ -|- 2“”^ 2“”''= with ni < 712 < • • • < £ N, because then given any 

e > 0, approximate it from below by a nondecreasing sequence ^ e~ (and from above by a 
nonincreasing sequence e'^ —)• e"*"), with each en,e'^ a finite sum of the above form. (For instance, 
take Cn to be the truncated binary expansions of e.) Then, 

/^i/2(H(0,e, IHI^ ^)) ^/^i/2 IMI^,2)^ = J-|^/^i/2(H(0,en, 11 - 11 ^ 2 )) 

= lim €n = e, 
n—^oo 

and similarly, //i/ 2 (H( 0 , e, IMI. 0 ^ 2 )) ^ lim^^oo £„ = e- 

Thus it remains to prove the assertion for e = + 2“”^ 2“”'=; we do so by induction 

on k > 0. For /c = 0 the result was proved earlier in this proof; from this the result follows 
for fc = 1 by using Proposition 12.101 and Equation (|2.14p . Now given the result for k — 1 > 
0, set e' = X]g<j<fc 2“"* and e = e' -|- 2“"''=. The graphs in H(0,e, 11-11^2) have possible ||•||^ 2 " 
values in [0, e) = [0, e') ]J{e'} ]J(e', e). Using that the binary expansion is a bijection from [0,1] to 
binary sequences (except on a countable set described in Theorem II.4j) . one notes that the graphs 
corresponding to the first two sets of ||•|^ 2 walues above are, respectively, Sy := il(0, e', 2 ) 

and the doubleton set S' := {Tfc_i, Tfc _2 U{nfc-i + 1, Ufc-i -|- 2,... }}, where := {ni,..., n^} for 
all k. Moreover, if ||G||^ 2 ^ some G £ if(V), then it is not too hard to show (again using 

binary expansions, via Theorem 1 1.4p that from among the integers 1,..., re^, the only ones in t/’(G} 
are precisely ni,..., n/g-i- Thus, the graphs whose H-jl^ 2 walues lie in (e', e) form the set 

S" := (f({l,... ,nfc} \ Tk-i,Tk-i) \ {{ni,.. . ,nk-i,nk + l,nk + 2,... }}. 

Since points have zero measure, lii/ 2 («S'") = 2“”'= by Equation (|2.14p . Hence: 

/ri/2(H(0, e, |M|^_2)) = /^i/2 =«' + « + 2""'“ = U 

where the penultimate equality follows from the induction hypothesis and previous results. This 
completes the proof for open balls, by induction. 

For the closed ball B := B{G,e, ||•||.0 2 )^ if e = 1 then /ii/ 2 (H) = iri/ 2 (^(H)) = 1, while if e < 1, 

BiG, e, |M|,/,^ 2 ) B{G, e, ||•||^^ 2 ) = Pj B{G, e + n ||•|^_ 2 )• 

nSN 

Thus the result for closed balls follows from the result for open balls, since we have: 

e<Mi/2(H(G,e, 11 - 11 ^ 2 )) < + = 

(1—e)“-f<nGN 

□ 
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2.3. Examples: computing expectations. We now work out some examples of computing ex¬ 
pectations with respect to the probability measures on ^(V) that were introduced in Section [221 
In the following results, V is assumed to be countable. 


Proposition 2.15. Fix P : Ky [0,1] and a bijection ip : Ky —)■ N. Then every countable set 
has fip-measure zero if and only if max(P(e), 1 — P{e)) = 0. In particular, this holds if there 

eGKy 

exists e > 0 such that the set {e G Ky : P{e) G (e, 1 — e)} is infinite (e.g., if fJ-p = pip for p € (0,1 )). 
Proof. Given G G ^f(V) and n G N, first define 

PniG) := P{e) (l-P(e)), 7r„ := max(P(e), 1 - P(e)). 

eGEri{'ip)r]G eGEn{ip)\G eGEn{ip') 

Note that both Pn{G) and vr^ are non-increasing nonnegative sequences, with po{G) = tto = 1. In 
particular, they are both convergent. Moreover, note that 

{G}= f| ^({1,...,n}\G,Gn {!,...,n})VGGi^(E). 

riGN 


Now since p,p{S’{Io, Ii)) = — P(V' ^(*))) Pii’ ^(0) hnite disjoint subsets Io,Ii C N, 


we compute: 


i€lo 


i€ll 


0 < pip{G) = lim ({!,..., n}\G,Gn n})) = lim Pn{G) 

n^oo n—>-oo 

< lim TTn = fip{Gp), 
n—^oo 

where Gp (or its set of edges) equals {e G Ky : P{e) > 1/2}. Thus, every countable set has 
^P-measure zero, if and only if pp{G) = 0 VG, if and only if fJ.p{Gp) = 0. 

Finally, for the second sub-part, we simply note that infinitely many of the terms in the product 
are less than e < 1, so //p(Gp) =0. □ 


In order to state the next result, first recall some notation from |KRlj . 

Definition 2.16 f |KRlj l. Let R be a countable labelled set. 

(1) Define £\{Ky) := |(^ : Ky —)• (0,oo) j ip{e) < oo|. 

eGKy 

(2) Also define £’^{Ky) to be the set of functions C : Ky (0, oo) such that C{Ky) has precisely 
one accumulation point: 0 (and oo is not an accumulation point, i.e., C is bounded). 

(3) Further define £\{Ky) := {fi : Ky —(l,oo), ^ 

(4) Given 0 / G G ^{V), ip G £\{Ky), ( G £^(Ky), and G £\{Ky), define: 

•= ||G||“ := max{C(e) : e G Gj, ||0||J, = ||0||“ = ||0||^ := 0, 

eGG 

and ||G||^ := (neGG‘?^(^) “ with the smallest n G N such that 2"' > 1 -f neGR'v 

It was shown in |KR1] that the maps ||•||J,,||•||^ induce topologically equivalent translation- 
invariant metrics on graph space ^{V), which metrize its product topology. One can similarly 
show the following fact. 

Lemma 2.17. For all cf G £\^{Ky), the maps ||.||^ induce topologically equivalent translation- 
invariant metrics on ^{V), which metrize its product topology. 
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The following result provides examples of computing the expectations of the aforementioned func¬ 
tions (and others) with respect to the Erdos-Renyi type product measures Hp defined in Section 

ESI 

Proposition 2.18. For all p € (0,1), the expectation is a linear functional on the space of 
measurable functions h : —h M. 

(1) Given A; > 0 and a graph G G ^{V) with at least k edges, labelled by 'ipiG) = {ni < n 2 < 

■ ■ ■ < Uk < ■ ■ ■} C N, define the kth minimum edge number of G to he ^k{G) := Uk- Then 

^Up[^k] = k/p. 

(2) Given C, G choose any bijection : Ky —)• N as in Lemma \2. 1 S\ (below). Then 

for all f : im(C) —M, 

E,-,i/(iMini = Eai -pr-'fmpin)))- 

nGN 

(3) For all ip G f+{Kv) and G G ^{V), ||G||J, = Y.e€Kv ¥^(e)lGe^(0,V'(e)) • Moreover, 

^Ml]=p\\Kv\\l, ^upml?]=p{i-p)\\mi2+pH\\Kv\\l?- 

(4) If llRyll^ E — 2 for some c) & l\ and n > 0, then 

e&Kv 

In particular, if X : ^(R) —)■ M denotes the random variable X{G) := ||G||J,, then X has pp- 
mean pHiCyllJ,, and variance p(l — p)||i^^y||^ 2 - More generally, one can imitate the proof below 
to show that for all n G N, E^p[(||.||^)'^] = Kp^[X^] equals some “homogeneous” polynomial in 
{ll-Ryll^r = ||Ry||” : 0 < r < n}, with coefficients that are polynomials inp. (Here, “homogeneous” 
means that every monomial has the same total degree, with ||Rry||^r having degree r.) 

Also note that some of these results can be shown more generally for all pp (with P : Ky —)■ [0,1] 
as in Section E2])- For example, if ||Ry||^ < f/2'^ — 2, then 

EwIIMlil = E Ue)v(e). E^KIMIJ)”] = -1 + (1 - P{e) + P{e)4,{e)). 

e&Kv eeKv 

The following observation will be used to prove Proposition 12.181 

Lemma 2.19. For all C S £'^{Ky), there exists a bijection i/i = ■0^ : Ky —>■ N, such that 

c(V’-'(i))>c(rn2 ))>---. 

For instance if C(e) = ||e||^ ^ for fixed a > 1 and all e G Ky, then = a“”, so i/'c = f’- 

Proof. Since the only accumulation point of the image set (({Ky) is 0, it follows that for every 

e G Ky, there are only finitely many values above (({e) - and they can all be totally ordered. In 

other words, every subset of (({Ky) has a maximum element. Thus, define /3 : N ^ Ky inductively: 

/3(1) is any element of arg max C(e), and given /3(1),... ,f5{k — 1), define f5{k) to be any element 

c^Ky 

of the set argmaxC(e), where Sk '■= Ky \ {/3(1),... ,j3{k — 1)}. It is clear that this inductively 

eeSfc 

covers all e G Ky, by the previous paragraph. Hence /? : N —)• Ky is a bijection such that 
C(/3(l)) > C(/3(2)) > • • • • Now define := □ 
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Proof of Proposition \2.1^ 

(1) Note that iJifc is defined at all but countably many graphs in Moreover, the /cth 

minimum edge of G € is n if and only if n > fe and fjiG) H {1,... , n — 1} has size 

exactly k — 1. This means that G G <^({1, ■ ■ ■ ,n — l}\S,S ]J{n-}), where S' C {1,... , n — 1} 
has size precisely k — 1. Now there are precisely (^l|) such sets S, and by Proposition 12.151 
each corresponding set <^({1,... , n — 1} \ S', S' U{n}) has measure (1 — Hence we 

exclude the countable (measure zero) set of graphs with fewer than k edges, and compute: 

= E-' (t I (t)(i 

n=k ^ ^ n=k ^ ^ 

On the other hand, the Binomial Formula easily yields: 

= E(-1)' ^ (-0 - p))' = E (" D (1 - p)'- 

Setting I = n — k, the expected value above equals kp^ ■ = k/p. 

(2) Note that C(^^^(l)) > C(V'^^(2)) > • • • by choice of It is clear that ||G||^ = 

if G G ... , n — 1}, {n}), with denoting the £’-set corresponding to i/'c- Since these 

sets partition \ {0}, use Theorem lAl to compute: 

E,,l/(l|.|ir)l = E fmp(n))M<fc((U .... n - 1), {n))) 

neN 

nEN 


(3) Define /Ar(G) := J2n=iP(i’ ^('^))^Ge>g'(0,{n})- Thus, {fjvj is a nondecreasing sequence of 
[0, oo) valued ^-measurable functions on if(V). It is not hard to show that their pointwise 
limit at any G G ^(V) is 


^W)lGG^(0,{n}) = P(e)lGemWe)}) ^ Y = \\^v\\]p < OO. 

nGN e&Kv eeKy 


Moreover, in computing ||G||^, 99 (e) is a summand if and only if e G G, i.e., G G (f (0, {'0(e)}). 
This proves the first statement. Now use Proposition 12.151 and the Monotone Convergence 
Theorem to compute: 




N 


lim E. [/at] = lim vgjh-p 

N^oo " 7V->-oo^ \ r 

n=l 


99(0 0 n))/ip(J’( 0 ,{n})) 


Y^i'^ ^{n))-p = p\\Kv\\]p, 

n=l 
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which proves the first part of the second statement. For the second part, note that 
(IIG^llJj)^ = liuiAf^oo/w- Now write out the summand: 

N 

fN{G)= 

n=\ 

N n—1 

+ 2EE ^(n))lGG,r(0,{m})lGG,r(0,{n})- 

n=l m=l 

Taking expectations yields: 

N N n-1 

^i^pifNiG)] = +2p‘^ EE ifi'tp ^(n)) 

71=1 71=1 771=1 

N / N 

71=1 \ 71=1 

From above computations, the second term is just E^p[/jv]^, which converges to {p ||i^u||^)^ 
by the first part. Hence as above, using Proposition 12.151 and the Monotone Convergence 
Theorem, E^J(||G||J,)^] equals ^l^E^J/|r(G)] = p{l - p)\\Kv\\l 2 + || 

(4) This is similar to the previous part: define 

N 

fN{G) := n (^ + - l)lGe^(0,{n})) ■ 

71=1 



Once again, 0 < fN{G) < /Ar+i(G') < ^ G-, so we can apply the 

Monotone Convergence Theorem. Moreover, the pointwise limit of the /w is precisely 
l + dMI^)") one easily checks that the expectation of any product of k distinct indicators 

N 


as above is p^. This proves that £^^[1 + (II.H^)”'] 
the result follows. 


lim TT(1 +p((/)(V’ ^(n)) - 1)), and 

N^oo 

71=1 


□ 


3. HAAR INTEGRATION AND FOURIER ANALYSIS 

We now study graph space ^(V) in further detail. Recall that ^{V) is a compact topological 
group; these are objects for which a comprehensive theory of analysis and probability has been 
systematically developed in the literature - see e.g. [Orel IPal IP,uj . In this section we further 
explore two aspects of the theory: hrst, we find a more familiar model for graph space as a compact 
group with Haar measure. Second, we study Fourier analysis on ^(H). This includes classifying 
the Pontryagin dual, as well as all positive dehnite functions on ^iV). 

3.1. Haar integration on graph space. In this part we study the relationship between the Haar 
measure on ^(V) and the Lebesgue measure on M. As seen above, the Haar measure of an e-ball is 
e. This property also holds (up to scaling by 2) for the usual Lebesgue measure /tr on the real line. 
Thus, it is natural to ask if the two measure spaces (^(V), puaar = Pi/ 2 )> and (M,/ir) - or more 
precisely, the circle group with its Haar measure - are related. If so, how does one account for 
the “Jacobian” in transforming Haar integration from ^(V) into the usual Lebesgue theory on M? 
These questions are the focus of the next main result in the paper. 
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Proof of Theorem\^ Note that 11 - 11^2 ^ continuous map : {f(V) —>■ M, hence (Borel) measurable 

with respect to the respective Borel a-algebras. Thus, consider two measures on the Borel cr-algebra 
S^y{y)i given by ^ i-A /ii/ 2 (^) A i-A ^k(||^||^ 2 )- The latter is indeed a measure that satisfies 
countable additivity because H-H^ 2 is a bijection except on a countable set, and countable sets have 
measure zero in either measure. 

We now claim that the measures /ii /2 and /iro H-H^ ^ on (y), agree on all sets h) 

for finite disjoint Iq) -^1 C N. If this holds, then since these sets are closed under finite intersections. 
Proposition 12.121 implies that these measures are identical (using Theorem 12.4p . This proves the 
first assertion. 

To prove the claim, recall from [Cam] that ([0,1], /ik) is equivalent ~ via binary expansion - to the 
countable sequences of independent tosses of a fair coin. Moreover, countable sets have probability 
zero in all cases, and the set corresponds precisely to all sequences where the zth coin toss 

is a tail if i G Iq) and R head if i G /i. In turn, these correspond to the set of all x G [0,1] whose ith 
digit in the binary expansion is 0 if i G Iq and 1 if i G /i - and these sets are measurable because 
they are unions of intervals. It is now clear, by partitioning [0,1] into 2 ™®'^ToU/i)_j^g^j^y intervals of 
equal length, that each of these sets has measure which proves the claim. 

We now show the second assertion. Note that f{x) = ±00 only on a set of measure zero, since / 
is Lebesgue integrable. Next, the functions ;= max(±/, 0) are also measurable (and integrable) 
if / is; hence by linearity it suffices to prove the result for each of them. Thus, suppose without 
loss of generality that 0 < / < 00 . We carry out a standard construction to approximate / by a 
sequence of nonnegative simple functions 0 < /i < /2 < • • • on [ 0 ,1], which converge pointwise to / 
almost everywhere. Given n G N, define In,k '■= for 1 < /c < 2^"', and In, 2 '^^+i '■= [2”, 00 ). 

Now define An,k ■= f~^{In,k) C [0,1], and Bn,k ■= {G G ^(P) : /(||G|^ 2 ) ^ ^n,k}- Thus by 
Theorem m both An,k and Bn,k are measurable and of equal measures. Now define the functions 


22"+1 

fn--= E 


k=l 


k-1 
2^1 ^ 


9n • — 


22"+1 

E 


k=l 


k-l 

-Is t ■ 

2n ^n,k 


It is then standard that 0 < fn < fn+i < / at each point, and /n(x) —)• f{x) for all x. The 
same facts also hold for gn and g, where we define: g{G) := /(||G||^ 2 ) gn{G) := fn{\\G\\,^ 2 )- 
Moreover, since H-H^ 2 is measure-preserving, the simple functions fn,gn are pullbacks of each other 
(via the invertible map 11 - 11^2 ^^d its inverse - outside the countable set %(P), say). Hence, 

fn{x) dx= fn d/iR Vn G N. 

Jo 

Now use the Monotone Convergence Theorem twice: 



E 


'k-i/2 y 


[/(ll•M] = E 


'k-l/2 




[gn] = lim 

n—)-oo 


f 


fn{x) dx= f{x) dx. 


□ 


Remark 3.1. Note that 11 - 11.0 2 i® ^ bijection on ^(V); thus to make sense of (|M |0 2 )~^> 
ignore all finite graphs %(P), and/or cofinite graphs ^i(V) (since all countable sets have measure 
zero). Then IHI^ 2 i® ^ measure-preserving bijection on the complement, whence a random variable 
Ty{V)\%{V) is measurable if and only if T o (||•|| 0 _ 2 )"^ : [0> 1] \ ll%(^)IU ,2 ^ ^ 

is measurable. 


Remark 3.2. We now illustrate an application of Theorem [Bl Recall the definition of the “fcth 
minimum edge number” as defined in Proposition 12. 18 T I). One can now show that 


Ti(G) = min?/(G) := -Llog 2 ||G|| 0 ^ 2 J- 
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More generally, 'I'fc(G) can be inductively defined as /fc(||G||^ 2 )! where: 


fc-i 


fk{x) := fi ^ 




fi{x) := -[logaxj. 


2=1 


In particular, one can compute the expected value of 'hi (with respect to H 1 / 2 ) using Theorem iBl 
to be — / L1 oS2 (^)J dx, which can be shown to converge to 2. Recall that this expectation was 

Jo 

also computed in Proposition I2.18l lb 

3.2. Pontryagin duality and Walsh-Rademacher functions. We conclude the paper with a 
discussion of Fourier analysis in graph space. We require the following terminology. 


Definition 3.3. Suppose V is any fixed vertex set. 

(1) A function / : 1^(1/) —)■ C is positive definite if for all integers n £ N and Gi,..., Gn £ 
the matrix (/(GjAGj))i<jj<„ is positive semidefinite. 

(2) Given a finite graph E £ %( R ), the corresponding Walsh funetion xe ■ '^{V) — ^ C is 
defined as follows: 

Xe{G) := = 

cGE 

The Walsh functions turn out to be important for several reasons, including for Fourier analysis 
via Pontryagin duality. Recall the following terminology: 

Definition 3.4. A unitary character of a group is a group homomorphism y : —)• 5^, the unit 
circle in . The Pontryagin dual of a locally compact abelian group is simply the set of continuous 
unitary characters, which form a group under pointwise multiplication. 

Note for ^ = ^(V) that all unitary characters have image in {±1}, since ^f(V) is a group with 
exponent 2. Now the following result completely characterizes all positive definite functions on 
^(V), as well as its Pontryagin dual. 

Theorem 3.5. Suppose V is a eountable set. Then the Pontryagin dual to ^(V) is naturally iden¬ 
tified with its subgroup ^o{V) of finite graphs, via Walsh functions. They also form an orthonormal 
basis 0 /M). 

Moreover, a function f : ^(V) C is positive definite and satisfies /(O) = 1, if and only if 
there exists a probability measure /r on %(P) (i.e., a countable set of nonnegative numbers pi{H) 
that add up to 1 ), such that 

/(G) = E 

(In particular, / has image in [—1,1].) 

Since (R) is a compact abelian group, one can also apply the theory of Pontryagin duality to 
carry out Fourier analysis on it, or to state Parseval’s identity and Plancherel’s theorem (a useful 
reference is |Rul Chapter 1]). We now write down some of the results in this setting. 

Proposition 3.6. Suppose V is an arbitrary set (of labelled vertices). 

(1) The “group algebra” L^(5^(R),M) is a Banach algebra under eonvolution. 

(2) The set of Walsh functions {xe '■ E £ %(R)} is an orthonormal subset 0 /T^(1^(R), M). 
When V is eountable, the Walsh functions form a complete/Hilbert basis; moreover, they 
transform into the usual Walsh functions - i.e., products o/Rademacher functions - via the 
Haar measure-preserving map ||•|L 2 • 
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Note that the first part follows from |Rul Theorem 1.1.7], and the second part follows from Theorem 
[B1 since the Walsh functions form a complete orthonormal system in T^([0,1],M). Moreover, they 
comprise the Pontryagin dual of ^(V): 

Theorem 3.7. Suppose is the Pontryagin dual group to {f(V) for a set V. 

(1) For all finite sets E G we have xe £ , with image in {±1}. 

(2) is a discrete (locally compact) abelian group, which is metrizable ifV is countable. 

(3) (Plancherel’s Theorem.) The Fourier transform, when restricted to {L^ (1 L‘^)fi^{V)), is a 

linear isometry in the L?-metric, onto a dense subset of Flence it has a unique 

extension to a unitary operator from onto (for some Haar measure 

on 

(4) When V is countable, ^ is precisely the set of Walsh functions, and the assignment xe 
E := {e £ Ky : XE{{e}) = —1} is a group isomorphism onto (?fo(P), A). 

Proof. To show (1), one shows that X{e} is continuous for each e G Ky. 

X{-'}(-l) = 

and these are both open by Proposition 12.101 Note that by [Pul Theorem 1.2.5], 5^^ is discrete 
since is compact. Similarly, is metrizable since is separable. This proves (2). Part 

(3) is shown (for more general 1#) in [Pul Theorem 1.6.1]. Part (4) is also not hard to show ~ see 

e.g. [Filimj. □ 

Finally, we prove the remaining unproved result above. 

Proof of Theorem I,?. ,51 All but the last assertion follow from Proposition 13.61 and Theorem 13.71 
To prove the last part, apply Bochner’s Theorem [P.ul Theorem 1.4.3] to the compact abelian 

group f^{V). Thus, every normalized function / is of the form f{G) = / f{G) dp{^) for some 

probability measure p on 1#^. Since = %(F) from above, every measure is a countable tuple 
as claimed. □ 

Concluding remarks. In this paper we analyzed measures and integration on labelled graph 
space fSiyf We showed that if(V) with its Haar measure is very closely related to the circle with 
its Haar measure, which allowed us to transport Haar-Lebesgue integration on [0,1] over to graph 
space ^(V). 

A more involved task is to study random graphs - i.e., sequences of l^(H)-valued random vari¬ 
ables. This involves the analysis of measurable functions from a probability space into '^{V) (as 
opposed to real-valued functions of graphs studied in this paper). Note that graph space ^{V) is a 
2-torsion group, and hence does not embed as a group into a normed linear space. Thus the next 
step in the study of labelled graphs and their limits involves developing the foundations of proba¬ 
bility theory on 1^(H), and studying probability inequalities and stochastic convergence on random 
graphs. The study of probability theory on graph space is addressed in forthcoming work |KH,2j . 
Such a formalism is essential in order to discuss issues like probability generating mechanisms for 
graphs, or to sample from graph space. 

Acknowledgments. We thank David Montague and Doug Sparks for useful discussions. 
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